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SYSTEMS AND METHODS FOR MEASURING AT LEAST TWO 
VISUAL PROPERTIES OF AN OBJECT 
TECHNICAL FIELD 

This invention relates to apparatuses and methods for determining at least two 
5 different visual properties of an object. 

BACKGROUND ART 

The price achieved by a consignment of raw wool at auction in Australia is 
currently dependent on a combination of the meas Jred values for some properties as 
listed in the pre-sale catalogue and the buyer 1 !, assessment of a sample of the 

io consignment. Given the demands from the international market for more objective 
assessment Of all wool properties and the potential improvement in wool prices and 
other economies if the sale could be based entirely on objective measurement, work 
has been done to quantify most of the remaining known but uhmcasured wool 
properties , typically known in the wool trade as "style" or "type". There is a need 

15 for objective assessment of wool staples to provide "style" or * type'* 
measurements. 

OBJECTS OF INVENTION 

Objects of this invention are to provide apparatuies and methods for determining at 
least two different visual properties of an object. 

* •« 

\}p DISCLOSURE OF INVENTION 

: ": -According to a first embodiment of this invention there is provided a method for 
\\ m determining alt least two different visual properties of an object, comprising; 
(I) determining a first parameter of the objeci by: 

* : (a) locating the object in a first parameter measurement interaction volume; 

25 (b) illuminating the object in the first parameter measurement interaction 
:\ volume with a light field selected from the grc-up consisting of a substantially 
uniform measurement light field and an effectively uniform measurement light 
field to produce non surface relief measurement outgoing light containing visual 
information related to non surface relief features of the object; 
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(c) detecting the non surface relief measurement outgoing light and generating 
signals therefrom whereby the signals are a function of the first parameter; and 

(d) determining the first parameter frotn the signals; 
(II) determining a second parameter of the object by; 

6 (a 1 ) locating the object in a second parameter measurement interaction volume; 

(b') illuminating the object in the second parameter measurement interaction 
volume with a directional measurement light field so as to produce surface relief 
measurement outgoing light containing visual information related to surface relidf features 
of the object; 

10 (c') detecting the surface relief measurement outgoing light and generating signals 
therefrom whereby the signals are a function or' the second parameter; and 

(d') determining the second parameter from the signals; 
wherein at least one of steps (b) and (b 5 ) comprises illuminating said object at a location 
selected from the group consisting of; on a reflecting surface, on a gloss black surface, on 
ib a substantially non-reflecting surface, on a flit black matt surface, against a reflecting 
background, against a substantially non-reflt-cting background, against a gloss black 
background, and a against a flat black matt batcground. 

Steps (I) (a) - (d) can be performed before, at the same time or after steps (II) 
(a') - (d*). Steps (I) (a) - (d) and steps (II) (a') - (d 1 ) can be performed automatically or 
20 non-automatically such as manually or batchwi: e. 

According to a second embodiment of this invention there is provided a method for 
determining at least two different visual propenies of an object, comprising: 
(1) determining a first parameter of the object by: 

(a) locating the object in a first parameter measurement interaction volume 

25 (b) illuminating the object in the First parameter measurement interaction volume 
with an effectively uniform measurement lighi field comprising a non flat light field to 
produce a non surface relief measurement ou;going light containing visual information 
related to non surface relief features of the obje:t; 

(b) (i) normalising the image of the object against an image of a substantially uniform 
30 flat white or substantially uniform flat near whlcc object; 

(c) detecting the non surface relief measurement outgoing light in the same light 
field and generating signals therefrom whereby the signals are a function of the first 
parameter; and 

(d) determining the first parameter from the signals; 
35 (I) determining a second parameter of he object by: 

(a 1 ) locating the object in a second parameter measurement interaction volume; 
(b 1 ) illuminating the object in the second parameter measurement interaction 
volume with a directional measurement light field so as to produce surface relief 
measurement outgoing light containing visual information related to surface relief features 
of the object; 
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(c ? ) detecting the surface relief measurement outgoing light and generating signals 
therefrom whereby the signals are a function o); the second parameter; a&d 
(d*) determining the second parameter from the signals. 

According to a third embodiment of this :nv<?ntiou there is provided an apparatus for 
6 determining at least two different visual properties of an object, comprising: 
(1) means for determining a first parameter of the object comprising; 

(a) means for locating the object in i first parameter measurement interaction 
volume; 

(b) means for illuminating the object in the first parameter measurement 
10 interaction volume with a light field selected from the group consisting of a substantially 

uniform measurement light field and an effectively uniform measurement light field to 
produce non surface relief measurement outgoing light containing visual information 
related to non surface relief features of the object; 

(c) a detector for detecting the non surface relief measurement outgoing light and 
is generating signals therefrom whereby the signals are a function of the first parameter, the 

detector being operatively associated with the means for illuminating of (b); and 

(d) mecins for determining the first parameter from the signals, the means for 
determining being operatively associated with the detector of (c); 

(I) means for determining a second parameter of the object comprising: 
20 (a J ) means for locating the object in a second parameter measurement interaction 
volume; 

(b') means for illuminating the object in the second parameter measurement 
interaction volume with a directional measurement light field so as to produce surface 
relief measurement outgoing light containing visual information related to surface relief 
25 features of the object; 

(c') a detector for detecting the surface relief measurement outgoing light and 
generating signals therefrom whereby the signals are a function of the second parameter, 
the detector being operatively associated With the means for illuminating pf (b 1 ); and 

(d*) means for determining the second parameter from the signals, the means for 
30 determining being operatively associated with tlie detector of (c'); 

wherein at least one of said measurement interaction volumes of (b) and (b') there is a 
surface or background proximate a location wh^re side object is illuminated or means for 
locating a surface or background proximate a location where said object is illuminated, 
said surface or background being selected from the group consisting of: a reflecting 
35 surface, a gloss black surface, a substantially non-reflecting surface, a flat black matt 
surface, a reflecting background, a substantially non-reflecting background, a gloss black 
background, and a flat black matt background therein when said object is illuminated at 
said location said object is at a looation sele;ted from the group consisting of: on a 
reflecting surface, on a gloss black surface, on a substantially non-reflecting surface, on a 
flat back tnatt surface, against a reflecting background, -against a 
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substantially non reflecting background* agaiivst a gloss black background, and against a 
flat black maLt background. 

The apparatus of the second embodiment may be arranged to determine at least two 
different visual properties of an object, automatically or non-automatically such as 
e manually or batchwise. 

Typically the substantially uniform measurement light field is also a substantially 
constant measurement light field, and, in particular, is a flat light field. Typically the use 
of an effectively uniform measurement light field comprises illuminating the object with a 
non flat light Field and normalising the inuge of the object against an image of a 
10 substantially uniform flat white or substantially uniform flat near White object as detected 
by detecting the outgoing light (by the detector) in the same light field. 

The first parameter(s) measurement interaction volume may be different from, 
overlap with or be coincident with the second paramater(s) measurement interaction 
volume. When the first and second parameter(s) measurement interaction volumes afe not 
16 spatially separated the volumes are illuminated with the substantially uniform 
measurement light field or the effectively uniform measurement light field and the 
directional measurement light field light at different times. In one particular 
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form of the invention the first paxameter(s) measurement interaction volume is 
different to the second parameter(s) measurement interaction volume. The apparatus 
may include means to separate the first parameter(s) measurement interaction 
volume from the second parameter(s) measurement interaction volume. The object 
5 may be measured (i.e. illuminated) on a reflecting surface (eg a gloss black surface) 
or substantially non-reflecting surface (eg a flat black matt surface) or against a 
reflecting background (eg a gloss black background) or substantially non-reflecting 
background (e.g. a flat black matt background) in the first and/or second interaction 
volumc(s). Typically at least one of steps (b) and (:') (typically at least step (b') and 
10 more typically both steps (b) and (b*)) comprise illuminating the object on a flat 
black matt surface or on a gloss black surface or against a flat black matt 
background or against a gloss black background. 

The detector for detecting the non surface relief measurement outgoing light and 

the detector for detecting the surface relief measurement outgoing light may be 

15 separate detectors but is typically the same detector. Generally the detector is an 

image detector such as a video camfira, line scan camera dr a flying spot scanner. 

Generally the video camera is a colour video camera which, has a high resolution 

lens, such as an SLR lens such as are made and scld by Olympus, Pentax or Nikon 

(as opposed to a C-mount lens). Examples of suitable video cameras are those of 

20 broadcast quality, studio or ENG cameras. 
• * • • 

The object may be a solid or a collection of solic materials, such as a collection or 

clump of fibres, or other matter. Examples of objects include mechanical objects, 

\*\; mineral objects, such as diamonds and other crystal, organic and inorganic 

• * • contaminants, fibrous objects, randomly shaped objeits. spherical objects or cylindrical 

. £5 objects. Fibrous objects may be woven or twisted fibrous objects such as a clump of 

fibres and in particular fibre staples, such as for exartple taw wool staples, The fibrous 

objects may be synthetic fibres or natural fibres, dyed fibres, a textile product such 

\* m : as a strand, filament or yarn, or clumps or staples thereof. Other examples of clumps, 
•••• 

strands, fdaments or yams, may be ones of fibreglsss, hessian, nylon, glass, polnosic 
b .^JD and polyester, abaca, silk, jute, flax and cellulose fibres (including paper, recycled 
paper, corn stalks, sugar cane, wood> wood siavings, bagasse, wood chips), 
regenerated fibres Such as viscose, rayon, cuprammcnium r^ycrx and cellulose acetate, 
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sisal, carbon, stainless steel, vegetable fibrous material, polyolefin clumps, strands, 
filaments or yarns, such as polyethylenes and polypropylene, steel, boron, copper, 
brass, teflon, dacron, mylar, aluminium, aluminium alloy, poiyamide, polyacrytic, or 
absorbent clumps, strands, filaments or yarns, such as nylon 66 polyacryloriitrile, or 
5 polyvinyl alcohol and absorbent types of polyesters or polyacrylics, edible vegetable 
clumps, strands, filaments or yarns, such as wheat, flax, or inedible vegetable clumps, 
strands, filaments or yarns, such as wood pulp or cotton, anitnal clumps, strands, 
filaments or yarns, such as meat, alpaca, wool fibres such as wool fibres from sheep or 
other wool producing animals, hairs, such as hutoan hairs, goat hairs, cattle hairs, or 
10 feathers, yarns including wool and cotton yarns, (especially dyed wool, rabbit hair, 
kangaroo fur, mohair and cotton yarns as well as staples), string, wire, optical fibres 
for example. 

The interaction producing non surface relief measurement outgoing light is 
typically one or a combination of non specular reflection, scattering, fluorescence, 
15 stimulated emission, polarisation rotation, and other polarisation effects, or optical 
absorption. 

The interaction producing surface relief measurement outgoing light is typically 
one or a combination of reflection, scattering, fluorescence, stimulated emission, 
shadowing, polarisation rotation, and other polaris ition effects, occlusion, or optical 
20 absorption. 

Means for illuminating the first parameter(s) measurement interaction volume 
may be one or more light sources selected from, for example, incandescent sources, 
m \ such as tungsten filament source, tungsten-halogen lamps including quartz-iodine 
J lamps, broad band light sources approximating white light or a combination of brond 
25 band light sources approximating white light. Advantageously, a wide band, visible 

9 

light source(s) that approximates a black body radiaior ahd maintains a constant colour 

» 

temperature is used. 

Means for illuminating the second parameter(s) measurement interaction volume 
may be one or more light sources selected from, for example, incandescent sources, 
30 such as tungsten filament source, tungsten-halogen lamps including quartz-iodine 
: lamps, fluorescent lights, vapour lamps such as halogen lamps including sodium and 
iodine vapour lamps, discharge lamps such as xenon arc lamp and a Hg arc lamp, solid 
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state light sources such as photo diodes, super radiant diodes, light emitting diodes, laser 
diodes, electroluminescent light sources, frequency doubled lasers, laser light sources 
including rare gas lasers such as an argon laser, argon/krypton laser, neoh laser, helium 
neon laser, xenon laser ahd krypton laser, carbon monoxide and carbon dioxide lasers, 
6 metal ion lasers such as cadmium, zinc, mercury or selenium ion lasers, lead salt lasers, 
metal vapour lasers such as copper and gold vapour lasers, nitrogen lasers, ruby lasers, 
iodine lasers, neodymium glass and neodymium YAG lasers, dye lasers such as a dye 
laser employing rhodamine 640, Kiton Red 620 or rhodamine 590 dye, and a doped fibre 
laser. 

to Direct or indirect illumination may be used. Indirect illumination may employ 
optical fibres, reflectors Such as mirrors or white surfaces, for example, lenses or other 
refractive optical devices. 

The first parameter(s) may be colour, colour distribution, shape, diameter, area, 
chemical composition, number of parts, width, length, absorptivity, reflectivity, dielectric 
is constant, fluorescence, position, orientation, or density, for example. 

The second parameter(s) may be one or more surface relief features such as 
shadowing including self shadowing, surface texture including surface periodicity or 
regularity, or other surface detail, surface wavjness, surface crimp, surface roughness or 
surface profile, for example. 
20 The apparatus of the invention may include: 

(dd) means for determining statistical information in respect of a measurement of 
the first and/or second parameters) for an object, operativcly associated with the means 
for determining the first and/or second parameters; and optionally 

(ddd) means for determining statistical information ih respect of a plurality of 
26 measurements of (dd) for a plurality of objects, operativdy associated with the means for 
determining of (dd). 

Examples of statistical information include mean, standard deviation, coefficient of 
variation, variance, skewness, kurtosis, and otiier moments about the mean, spline fits, 
line fits including linear, exponential, logarithmic, multiple and polynomial regressions, 
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fractal fitting, mode, median, distribution fits including normal, gaussian, 'fermi, 
poisson, binomial, Weibull, parabolic, frequency, probability, cumulative and top hat 
distributions, data smoothing including running medians, means and least squares, table 
formation such as histograms and two way contingency, data manipulation for graphs, 
5 forecasting, probability statistics, simulations, pattern recognition, t test, chi square 
test, sample size, Wilcoxon signed-rank test, rank sum test, Kolmogorov-Smirnov test 
and boundary value and limit statistics. A more detailed description of statistical 
techniques is disclosed in G.EP. Box, W.G, Hunter and IS. Hunter, Statistics for 
Experimenters, John Wiley & Sons, Inc, New York USA, 1978, the contents of which 
10 are incorporated herein by cross reference. 

Generally, the apparatus of the second embodiment further comprises at least one of 
the following items: 

(i) means for determining the first parameter(s) of the object from measurement 
parameter(s) determined from the signals which are a function of the first 

15 parameters)* operatively associated with the detector(s) of (c); 

(ii) means for storing the measurement parametsr(s) determined from the signals 
which are a function of the first paiameter(s), operatively associated with the 
detector(s) of (c); 

(iii) means for storing the first parameter(s) of the object operatively associated 
1 20 with the means for determining the first parameters); 

9 » »• 

• » • a 

•j*. (iv) means for retrieving the measurement panjrteter(s) of the object operatively 
associated with means for storing the measurement parameter(s) determined from the 

*• signals which are a function of the first parameterO); and 

• ■ ■ 

(v)means for retrieving the first parameter(s) oi'the object operatively associated 
i.:"*? w ^ * e mcans f° r storing the first parameter(s). 
' "* r * BRIEF DESCRIPTION OF VRA WINGS 

.... Fig. 1 is a diagram of an implementation of an Instrument for measuring, 

• • • 

. , automatically, the style of wool staples; 

Fig. la is a diagram of a cross section through the ctmtre of the Tray Dropper Unit of 
';/39 the instrument of Fig. 1; 
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Fig. la is a diagram of a cross section through centre of the Tray Lifter Unit of the 
instrument of Fig. 1; 

Fig. 2 is a diagram of a Staple Tray used on Instrument of Fig. 1; 

Fig. 3 is a detailed diagram of the Optical Set-up of the implementation of the 
3 Instrument of Fig. 1; 

Fig. 4 is a diagram of the Optical Zones as seen by TV colour camera of the 
Instrument of Fig. 1; 

Fig. 5 is a flow diagram depicting the steps of saple colour analysis used by the 
Instrument of Fig, 1; 

10 Fig. 6 is a flow diagram depicting the steps of staple geometry analysis used by the 
Instrument of Fig. 1; and 

Fig. 7 is a flow diagram depicting the steps of staple crimp analysis used by the 
Instrument of Fig. 1. 

BEST MODE AND OTHER MODES FOR CARRYING OUT THE 
is INVENTION 

Referring to Figure ] an Instrument 1 for determining style properties of wool is 
depicted. Instrument 1 comprising several major subsystems: 

• Mechanical Tray Handling subsystem 2 for passing Tray Stack 701b containing 
wco1 sta ples on a Conveyor 300 under the TV colour camera 405, consisting of a 

• » ■ * 

_ : j2Q Tray Dropper unit 100, a Tray Lifter unit 200 and a Conveyor 300, illustrated in 
Figure 1, with cross sections of Tray Dropper unit 100 in Figure la and of Tray 

mm • 

*■ Lifter unit 200 in Figure lb; 

« • » 

• Tray Stack 701b for the carriage of the wool staples to be measured through the 
Mechanical Tray Handling subsystem 2 as illustrated in Figure 2; 

• • • • 

***13 • Imaging subsystem 400 comprising a Lighting arrangement 401, a Baffles set 

.>..^ 410 as illustrated in Figure 3 to combine the necessary lighting fields within the 
»# • 

field of view of TV colour camera 405, both attached to the Mechanical Tray 
Handling subsystem 2; 

» * • 

* • • 

;/\ • Microcontroller 601 interfaced to actuators and sensors on the Mechanical Tray 

• • • j 

30 Handling subsystem 2 and to the Host computer 610, as Shown in Figure 1; 
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• Electrical Power Supply 620 and a Compressed Air Supply 630 to power the 
Mechanical Tray Handling subsystem 2 as shown in Figure 1; and 

• Host computer 610 with an internal or optionally external image acquisition 
interface also known as a frame-grabber and linkc*l to the TV colour camera 405 as 

5 shown in Figure 1. 

Mechankal Tray Handling subsystem 2 

Tmtimw mitlQQ 

The Tray Dropper unit 100 has four major components: the Tray Dropper Rails 
101a,b, the Tray Dropper Flaps 102a,b, the Dropper Back Wall 108 and the 
10 Dropper Front Bench 111. 

The two Tray Dropper Rails 101a,b are locatec. on the front and the back of the 
Conveyor 300 at the input end. Each Dropper Rail consists of a stiff straight rail of 
approximately the length of a tray, arranged parallel to the Conveyor 300 and 
moving up and down. The movements are driven by Tray Dropper Rail pneumatic 
15 actuators 103a,b ( which are double-acting pneumatic cylinders with built-in guide 
rails, typically Festo part FEN-25-80 plus DSNU-25-80-P; the stroke is vertical. 
Pneumatic needle valves, typically Festo part GRLA-l/B, are included on both 
inlets to each pneumatic cylinder to control the sj>eed of operation in both up and 
down directions. The stroke length of the Tray Dropper Rail pneumatic actuators 
„:;2fl 103a,b are 80 mm each and not adjustable. The Tray Dropper Rail pneumatic 
actuators I03a,b arc mounted on the Conveyor sids panels 301a,b. Operation of the 

* »*» 

11 | Tray Dropper Rails 10la,b is controlled b> the Microcontroller 601 via 

• • • 

Microcontroller-Dropper control and sense line 6D3 through a single-pole double- 
throw electro-pneumatic valve 605, typically Festo part 6068-MFH-5-3.3. There are 
Tray Dropper Rail pneumatic actuator sensors I0<ia*d, typically Festo part SMEO- 

•••• 

• 4-K-LED-24, at both ends of the Tray Dropper Rail pneumatic actuators 103a,b to 

.... detect fully-up and fully-down positions. Thrse sensors are linked to the 

• • • 

Microcontroller 601 via the Microcontroller-Dropper control and sense line 603. 

The two Tray Dropper Flaps 102a,b are located parallel to the Tray Dropper 

l]fS 9 Rails 10la,b and outside them. Each flap consists vf a stiff angle section mounted in 

• . « 

an inverted L position, with a Tray Dropper Flap hirige 107a/b at the bottom 
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connected to the Tray Dropper Frame 1 12 which is attached to the Conveyor side 
panels 301a,b. The tops of the Tray Dropper Flaps 102a, b point inwards across the 
Conveyor 300 and are moved in and out by Tray Dropper Flap pneumadc actuators 
lOSa.b, which are double-acting pneumatic cylinders, typically Festo part ADV-20- 
3 10-A, the stroke is horizontal. A pneumatic needle valve, typically Festo part 
GRLA-M5-Pk3, is included on one inlet to each pneumatic cylinder to control the 
speed of operation in the inwards direction. The stroke length of the Tray Dropper 
Rail pneumatic actuators 103a, b is about 10mm. Operation of the Tray Dropper 
Flaps 102a,b is controlled by the Microcontroller 601 via Microcontroller-Dropper 

10 control and sense line 603 through a single-pole double-thfow electro-pneUmatic 
valve 606, typically Festo part 6068-MFH-5-3.5. There are Tray Dropper Flap 
pneumatic actuator sensors 106a-d 3 typically Festo part SME-3-LED-24, at both 
ends of the Tray Dropper Flap pneumatic actuators 105a,b to detect fully-in and 
fully-out positions. These sensors are linked to the Microcontroller 601 via the 

15 Microcontroller-Dropper control and sense line 603. The Dropper Back Wall 108 is 
a flat plate rising vertically from the back of the Tray DrOpper unit 100 with two 
vertical Dropper Back Wall guides 109 & 110, one at each end of the Dropper Back 
Wall 108. The Dropper Back Wall 108 is located with respect to the Tray Dropper 
Rails I0la,b and Tray Dropper Flaps 102a,b such that a stack of Tray Stack 701b 

20 correctly located on the Tray Dropper Flaps 102 i,b is just touching the Dropper 
Back Wall 108; the two Dropper Back Wall guides 109 & 110 are located so as to 
constrain the two ends of the Tray Stack 701b in the stack. 

: The Dropper Front Bench 111 is a flat sheet arranged horizontally on the Tray 
Dropper Frame 112. This provides a safety guard over the Tray Dropper Flaps 

25 102a,b and as a temporary work surface for the operator while stacking trays. There 

are a number of optical beam sensors on the Tray Dropper unit 100. A Tray-Stack- 

Fault sensor* 505a, b is integrated onto the front Tray Dropper Flap 102a and the 

Dropper Back Wall 108. This sensor passes a beam from the Tray-Stack-Fault 

sensor emitter 505a on the Dropper Back Wall 1C8 to the Tray-Stack-Fault sensor 

. .30 receiver 505b on the front Tray Dropper Flap 102a through the stack of Tray Stack 
• • » 

7 0 lb. The beam passes above the bottom Tray 701 in the stack and Under the 

ft • • 

second bottom Tray 701, through the Tray inter- sic t gap 703 in the trays. The beam 
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is angled slightly downwards > such that it can only pass through the Tra) inter-slot 
gap 703 if the Tray Stack 701b are correctly stacked on the Tray Dropper unit 100. 
Any vertical mis-stacking of the Tray Stack 701b will cause the beam to be blocked. 
The Tray-Stack- Fault sensor 505a,b is typically sn Erwin Sick model WLL6-P122. 
5 There is a Tray-on-Stack sensor 501 located on the Tray Dropper Frame 1 12 at the 
outer end, and a Tray-on-Stack sensor reflector .S02 mounted on the Tray Dropper 
Frame 112 at the inner end of the Tray Dropper unit 100, The beam from the Tray- 
on-Stack sensor 501 passes along the Conveyor 300 to hit the Tray-on-Stack sensor 
reflector 502 which reflects the beam back along ihe same path to the Tray-on-Stack 
10 sensor 501. This path is so positioned that the bottom Tray 701 in the stack on the 
Tray Dropper unit 100 will block the beam. The Tray-on-Stack sensor 501 is 
typically an Erwin Sick unit model WL6-P172; (he Tray-on-Stack sensor reflector 
502 is. typically an Erwin Sick model PL3 1/9210. There is a Tray-under-ODropper 
sensor 503 and Tray-under-Dropper sensor reflector 504 located on the Conveyor 
15 300 in such a position that the beam is blocked by a Tray 701 dropped onto the 
Conveyor 300 by the Tray Dropper unit 100. This blockage is interpreted to mean 
there is something (typically a Tray 701 but possibly unwanted rubbish) somewhere 
on the input end of the Conveyor 300. The Tray-under-Dropper sensor 503 is 
typically an Erwin Sick model WL6-P172; the Tiay-under-Drdpper sensor reflector 
20 504 is typically an Erwin Sick model PL31/9210, 
\" Tray Lifter unit 200 

: - # The TYay Lifter unit 200 is similar to the Tray Dropper unit 100 but uses a Tray 

• Lifter Pawls 202 arrangement instead of flaps. The Tray Lifter Rails 201a,b are 

* # : similar in design to the Tray Dropper Flaps 10ia,b, and are driven by a similar 

m 25 arrangement of similar pneumatic equipment; Trc.y Lifter Rail pneumatic actuators 

./ 203a,b with Tray Lifter Rail pneumatic actuator sensors 204a-d controlled by a 

single-pole double-throw electro-pneumatic valve 607. The Tray Lifter Pawls 202 

are parallel to the Tray Lifter Rails 201a,b and so arranged as to rotate upwards 

when a Tray 701a is lifted from the surface of the Conveyor 300. When the Tray 

^0 701a has passed the Tray Lifter Pawls 202 they vill descend into the rest position, 
■ » 

, : such that the lifted Tray 701a can rest on them. The Tray Lifter unit 200 has a 
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vertical Tray Lifter Back guides 208a, b to provide vertical guidance to the outgoing 
Tmy 701a. 

There are a number of optical beam sensors on the Tray Lifter Unit 200. There is 
a Tray-at-End sensor 506 located on the Conveyor 300 near the Conveyor driven 
5 roller 303 such that a light beam is passed at right angles across the surface of the 
Conveyor 300 about 10 mm above the Conveyor belt 305 to sense when a Tray 
701a reaches the output end under the Tray Lifter unit 200. The Tray-at-End sensor 
506 is typically an Erwin Sick model WLL6-PJ22, Blockage of this beam is 
interpreted to mean that a Tray 701a has reached the end of the Conveyor 300 and 

10 is correctly positioned to be lifted by the Tray Lifte* Unit 200. There is a Tray- 
under-Lifter sensor 507 and a Tray-under-Lifter reflector 508 similar to the Tray- 
under-Dropper sensor 503 and Tray-under-Dropper sensor reflector 504 mounted on 
the output end of the Conveyor 300. The beam h positioned such that it will be 
blocked by a Tray 701a on the Conveyor 300 anywhere under the Tray-under-Lifler 

15 sensor 507 even when the Tray 701a is not interrupting the Tray-at-End sensor 506. 
This blockage is interpreted to mean there is something (usually a Tray 701a but 
possibly rubbish) somewhere on the output end of the Conveyor 300. The Tray- 
under-Lifter sensor 507 is typically an Erwin Sick model WL6-P172; the Tray- 
under-Lifter reflector 508 is typically an Erwin Sick model PL31/9210. 

m 

» »»• 

The Conveyor 300 consists of two Conveyor side panels 301a,b onto which the 

• R a » 

Tray Dropper unit 100, the Tray Lifter unit 200 and several optical sensors are 

» • » 

'» attached, a Conveyor free roller 302 at the input end and a Conveyor driven roller 
: * ' 303 at the output end, a Conveyor belt motor 30<- to drive the Conveyor driven 
. 2^ roller 303, and a Conveyor belt 305 around the two rollers* The top surface of the 

Conveyor belt 305 moves from the input end to the output end. 
The optical sensors attached to the Conveyor 300 include the Tray-under- 

Dropper sensor 503, the Tray-under-lifter sensor 507, the Tray-at-End sensor 506, 

• ♦ 

and three sensors located at the middle of the Cbri\eyor 300 in the region seen by 

• the TV colour camera 405: Tray Movement sensor A 509, Tray Movement sensor B 
\\: 510 and Tray Movement sensor C 511. Each Tray Movement sensor places a 

sensing beam at right angles across the Cpnveyor :)00 at about 10 mm above the 
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surface of the Conveyor belt 305. Tray Movement sensor A 509 and Tray 
Movement sensor C 511 are placed across the Conveyor 300 with a separation 
corresponding to the distance between two tray slots as shown in Figure 4. Their 
combined outputs provide a signal when a Tray 7Cla has advanced such a distance 
5 that the next Tray Slot 702 has moved into the TV camera field of view 460. Tray 
Movement sensor B 510 is placed in between Tray Movement sensor A 509 and 
Tray Movement sensor C 511, one and a half slot spadngs from Tray Movement 
sensor A 509 and one half a slot spacing from Tray Movement sensor C 511, such 
that the beam from Tray Movement sensor B 510 ;s normally blocked when one or 

10 both of the beams from Tray Movement sensor A 509 and Tray Movement sensor C 
511 are not blocked, and vice versa. Tray Movement sensor A 509, Tray Movement 
sensor B 510 and Tray Movement sensor C 511 are typically Erwin Sick part 
WLL6tP122, It is not possible for a Tray 701a .0 be on Conveyor 300 without 
blocking at least on of the beams from the set of Tray-under-Dropper sensor 503, 

15 Tray-under-Lifter sensor 507 and Tray Movement :ensor B 510. 

A Staple Tray 701 is a rectangular tray approximately 715 rrim long by 200 mm 
wide, with typically seventeen slots in it. Each Tray Slot 702 is about 180 mm long 
by about 15 to 30 mm wide at the base and 10 mm deep, arranged generally as 
20 shown in Figure 2. The slots may be offset as shown in Figure 2 so as to maintain a 
separation of about 10 mm between trays when correctly stacked, or other 

*• •# 

ly 9 arrangements may be made to ensure that separation. There is a Tray inter-slot gap 
« * 

\: 703 as shown in Figure 2 between each Tray Slot 702 which is used by the Tray- 
•": Stack-Fault sensor 505a,b to check for correct toy stacking. An extended area is 
25 maintained at one end of Tray 701 to permit the attachment of a barcode label 642 

I./ or other means of automatic identification. 

• * 

The under-side of the Tray 701 may be smooth or may have small protrusions to 
ensure correct location and stacking. The material of the Tray 701 is of a black 

• »• 

colour. Typically it is made of plastic by vacuum-moulding, The top surface is 

30 .smooth and of matt finish or gloss finish; the under surface is smooth but otherwise 

• •« * 

\ : not specified. A tray newly dropped onto Conveyor 300 is referred to as Tray 701; 
a tray proceeding through the TV camera field of view 460 or on to the Tray Lifter 
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unit 200 is referred to as Tray 701a; a stack of taiys on the Tray Dropper unit 100 
is referred to as Tray Stack 701b. 
Imaging subsystem 400 

One arrangement of the Imaging subsystem 430 has 4 major components: the 
5 Colour Region Lights 421-426, the Crimp Region Lights 431-432, the baffles 411- 
415 and the TV colour camera 405. This is described as follows. 
Colour Retion Lights 421*426 

There are six quartz-halogen (or tungsten-iodine) Colour Region Lights 42M26 
with built-in dichroic reflectors for the Colour Region 420. These are arranged in 

10 two pairs 421,2 and 423,4 illuminating across the top tray slot 710 and one pair 
425,6 illuminating the length of the top tray slot 710 as shown in Figure 4, The 
beams from the Colour Region Lights 421-426 ;ire inclined at 30 degrees to the 
vertical. The Colour Region lights 421-426 have round Infra Red block filters 
428a-f in front of them to prevent heat from reaching the samples in Tray 701a. The 

15 placement of the Colour Region Lights 421-426 is designed to provide an even 
lighting field at the horizontal surface plane of the Tray 701 generally in the Colour 
Region 420 as described in "Operation of Instrument 1, Adjustment of Colour 
Region Lights 421-426", The lights are manufactured by General Electric and are 
12v 50w type EXN. 

,8Q The Colour Region Lights 421-426 are supported by the Colour Region Light 
support frame 427 which is supported by the TV Camera support plate 402. 
» Provision is made for adjustment of the position of the Colour Region Lights 421- 
\\ m 426 to create a flat field, as detailed under "Operation of Instrument 1*\ The Colour 
Region Lights 421-426 are all connected to Lighting power distribution block 440 
^Q ua ^ l en §* Colour Light leads 441-446. Lighdng power distribution block 440 
is supplied with +12.0 volts from Electrical Power Supply 620. 
Crimp Rerion Ltehts 431-432 

» • • 

There are two quartz-halogen (or tungsten-iodire) Crimp Region Lights 431-432 
with built-in dichroic reflectors for the Crimp Region 430. The beam frorh the 
Crimp Region Lights 431-432 is angled across the length of the bottom tray slot 712 
as shown in Figure 3. The beams from the Cximp Region Lights 431-432 are 
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inclined at about 30 degrees to the horizontal. The Crimp Region Lights 431-432 
have round Infra Red block filters 438a, b in front of them to prevent heat from 
reaching the samples in Tray 70 la. The placement of the Crimp Region Lights 431- 
432 is designed to provide a fairly even light field at the horizontal surface of the 
5 Tray 701 generally in the Crimp Region 430, but this does not have to be as 
uniform as for the Colour Region 420, The lights are manufactured by General 
Electric and are 12v 50w type EXZ. The Crimp Region Lights 431-432 are 
mounted close together on Crimp Region Light:; support frame 433, which is 
supported by the Colour Region Light support fratne 427, 
10 The Crimp Region Lights 431-432 are all connected to Lighting power 
distribution block 440 by equal length Crimp Light leads 447-8. 
Baffles set 410 

There are five baffles 411-415 arranged around the Colour Region 420 and 

Crimp Region 430 on baffle support frame 416 attached to TV Camera support 

15 plate 402 as shown in Figure 3. Baffle 411 is arranged to prevent illumination from 

Colour Region Lights 421 & 423 from landing on Crimp Region 430. Baffle 412 is 

arranged to prevent illumination from Colour Region Lights 422 & 424 from 

landing on Colour Region 420. Baffle 413 is arranged to prevent illumination from 

Colour Region Light 425 from landing on Crinp Region 430. Baffle 414 is 

7 t o arranged to prevent illumination from Colour Region Light 526 from landing on 
••• » 

Crimp Region 430. Baffle 414 has a square hole in it at the bottom, situated 

•* 

adjacent to bottom tray slot 712, such that light from Crimp Region Lights 431-432 
fall on Crimp Region 430, The first four member* of members of Baffles set 410 
listed above are placed symmetrically about the centre of TV camera field of view 
460. Baffle 415 is arranged to prevent illumination from Colour Region Light 526 
from landing on the Crimp Region, and also to pi event light from Crimp Region 
Lights 431-432 from landing on Colour Region 420. Baffle 415 is supported by 
Baffle 414. 

*fra» 
* • 

All baffles 411-415 and baffle support frame 416 are painted matt black to 
minimise reflected light. 

*• A second arrangement of the Imagirig subsystem 400 is described as follows. 



*a « 

• • • 
• ■* 



* « • 



• * m 



0Z0T39E6 2 19 CLLl SOINKQldblOd 



217:8 0002 'dUW*" 



16 



ColourAezion Li ghts 421 & 423 

There are two quartz-halogen (or tungsten-iodine) Colour Region Lights 421 & 
423 with built-in dichroic reflectors for the Colour Region 420. these are arranged 
as shown in Fig 3, illuminating across the top tray slot as shown in Figure 4. The 
5 beams from the Colour Region Lights 421 & 423 ?rc inclined at 30 degrees to the 
vertical. The Colour Region Lights 421 & 423 have round Infra Red block filters 
428a&c in front of them to prevent heat from reaching the Samples in Tray 70 la. 
The placement of the Colour Region Lights 421 & 423 is designed to provide a 
moderately even lighting field at the horizontal surface plane of the Tray 701 

10 generally in the Colour Region 420 substantially as described in "Operation of 
Instrument 1, Adjustment of Colour Region Lights 42M26". The lights are 
manufactured by General Electric and are 12v 50w type EXN. 

The Colour Region Lights 421 & 423 are supported by the Colour Region Light 
support frame 427 which is supported by the TV Camera support plate 402. 

15 Provision is made for adjustment of the position of che Colour Region Lights 421 & 
423 to create a moderately flat field, substantially as detailed under "Operation of 
Instrument 1". The Colour Region Lights 421 & 423 are connected to Lighting 
power distribution block 440 by equal length Colour Light leads 441 8c 443, 
Lighting power distribution block 440 is supplied with +12.0 volts from Electrical 

20 Power Supply 620. 

Crimp Rettion Lieht 4$1 

• m mm 
• • • • 

The quartz-halogen (or tungsten-iodine) Crimp Region Light 431 with built-in 
\\: dichroic reflector illuminates the Crimp Region 430. The beam from the Crimp 
: ' : Region Light 431 is angled across the length of the 3ottom ttay slot 712 as shown in 
. 2£ t Figure 3- The beam from the Crimp Region Lights 431 is inclined at about 30 
.••;\ degrees to the horizontal. The Crimp Region Light 431 has a round Infra Red block 
filter 438a in front of it to prevent heat from reaching the samples in Tray 701a. 
: The placement of the Crimp Region Light 431 is designed to provide a fairly even 
light field at the horizontal surface of the Tray 70 1 generally in the Crimp Region 
430, but this does not have to be as uniform as fur the Colour Region 420. The 

» m t 

\\t li £ ht is manufactured by General Electric and is of 12v 50w type EXZ. The Crimp 
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Region Light 431 is mounted on Crimp Region Lights support frame 433, which is 
supported by the Colour Region Light support frajne 427. 

The Crimp Region Light 431 is connected to Lighting power distribution block 
440 by Crimp Light lead 447, 

5 Mirror-Baffle set 412 & 415 

There is one baffle 412 arranged between th: Colour Region 420 and Crimp 
Region 430 on baffle support frame 416 attached to TV Camera support plate 402 
as shown in Figure 3. Baffle 412 is arranged to prevent illumination from Colour 
Region Lights 421 & 423 from landing on Crimp Region 430. Baffle 412 is also a 
10 minor arranged to reflect light from Colour Region Lights 421 & 423 onto Colour 
Region 420 from the side Opposite to the Colour Region Lights 421 & 423. Baffle 
415 is arranged to prevent illumination from Crin.p Region Light 431 from landing 
on Colour Region 420. 

Baffles 412 on the Crimp Region 431 side and Baffle 415 and baffle support 
15 frame 416 are painted matt black to minimise reflected light. 



TV colour camera 40S 

TV colour camera 405 is mounted on TV Colour camera mount 404, which has 

provision for fine adjustment of alignment in the \ orizontal and vertical planes. TV 

..:2<5 Colour camera mount 404 is located on TV Camera support plate 402 which is 

•\\\ % mounted on TV Camera support plate 402. TV Camera support plate 402 is 
» • • 

I mounted indirectly onto Conveyor 300 via an external TV Camera support plate 

* •» 

:V\ frame not shown in Figure 1. The output of TV colour cafriera 405 goes to the 

frame grabber in Host computer 610 via TV camen coax cable 406. 

'"[15 Field of View of TV colour camera 4tiS 

TV colour camera 405 is pointed down at the Colour Region 420 and Crimp 
Region 430. The image obtained from TV colour camera 405 is shown in Figure 4. 

»••? 

The image shows three tray slots arranged horizoitally: top tray slot 7l0 4 middle 

t „ B tray slot 711 and bottom tray slot 712, Vertically arranged on either side of the 

• *« 

,j\3j| image are Imaging Region Black & White reference areas 450 and Imaging Region 
Cyan, Yellow & Magenta reference areas 451. Colour Region 420 is generally 
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locaced within the area occupied by top tray slot 710 and as delineated by Colour 
Region virtual mask 720. Crimp Region 430 is generally located within the area 
occupied by bottom tray slot 712 and as delineated by Crimp Region virtual mask 
721. There is an unused optical region generally legated within the area occupied by 
middle tray slot 711 in between Colour Region virtual mask 720 and Crimp Region 
virtual mask 721. 

Microcon troller 601 

Microcontroller 601 is connected to Host computer 610 by Host-Microcontroller 
serial line 611, to Electrical Power Supply 620 by Microcontroller-Power Supply 
line 602, and the pneumatic actuators and various sensors on Mechanical Tray 
Handling subsystem 2 by Microcontroller-Dropper control and sense line 603, 
Microcontroller-Lifter control and sense line 604 and Microcontroller-Tray 
Movement sensors signal line 608. Each of these lines may contain several control 
and sensing signals. 

The Microcontroller 601 is typically an Arcom SC52 with optically isolated 
digital interface cards, typically Arcom SINP-16 for inputs and Axcom SD-16 for 
outputs. The program running on Microcontroller 601 takes high level commands 
such as "Clear conveyor" and "Advance to next tmy slot" from Host computer 610 
via Host-Microcontroller serial line 611 and controls the actuators and reads the 
sensors to cause the Mechanical Tray Handling subsystem 2 to perform chose tasks. 
On completion of the commands the Microcontroller 601 sends a "Done" reply to 
Host computer 610 over Host-Microcontroller serial line 61 L Any problems 
encountered in executing those commands are similarly reported back to Host 
computer 610. 

fffetfnVg/ Power Sunnlv 620 and Compressed Air ^ pp fy t ftQ 

The Electrical Power Supply 620 draws power from the standard 240v mains 
supply and generates DC power at 24v for the pneumatic equipment and optical 
sensors, 12v for the Colour Region Lights 42M2C and Crimp Region Lights 431- 
432, +24v for Conveyor belt motor 304 and lower voltages as required for the 
Microcontroller 601 (typically -H5v, -15v & +5v). 
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The +24v power to Conveyor belt motor 304 ;s controlled through a relay in 
Electrical Power Supply 620 by a signal in Microcontroller-Power Supply line 602 
from Microcontroller 601. The +24v power is delivered to Conveyor belt motor 
304 by Power Supply-Motor line 621, 

5 The +12v power to the Colour Region Lights 421-426 and Crimp Region Lights 
431-432 is controlled through a relay in Electrical Power Supply 620 by a signal in 
Microcontroller-Power Supply line 602 from Microcontroller 601. The +12v power 
is delivered to Lighting power distribution block 4*0 by Power Supply-Lights line 
622. The Compressed Air Supply 630 for the pneumatic equipment is derived from 

10 a source outside the Instrument 1. The primary supply of compressed air to the 
pneumatic subsystem (ie all the actuators) is controlled through a pneumatic dump 
valve in Compressed Air Supply 630 by a signal m Microcontroller-Air Supply 
control and sense line 609. Availability of compressed air for the pneumatic 
subsystem is sensed by a pressure sensor in Compressed Air Supply 630 connected 

15 to Microcontroller 601 by Microcontroller- Air Supply control and sense line 609. 

Host wwputtrGlQ 

Host computer 610 is connected to Microcontroller 601 via Host-Microcontroller 

: ^ serial line 611, to the dual-head Barcode Reader unit 640a, b via Barcode-Host line 
•• • » 

641 and to TV colour camera 405 through a typically internal frame grabber via TV 
camera coax cable 406. The program running on Host computer 610 effects control 

* • ■ 

*.: of Microcontroller 601 so as to cause it to move successive staples of wool into the 

• " • field of view of TV colour camera 405, acquis the TV images Of the staples 

: through TV colour camera 405, processes these images to extract the required 
«• • • 

information concerning the previously listed staple properties and any other 

25 appropriate information, and displays or disposes of the resulting information as 

• • • # 

: required. 

• • 9 9 * 

• • * * 

Operations f Instrument 1 
•XI' Adjustment of Colour Region Lights 421-426 in the first implemetation for 
*• *" successful analysis of the RGB images as outlined requires that the Colour Region 
30 Lights 421-426 be adjusted to produce a substantially flat field of light within the 

Colour Region 420. This is done as follows: 
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The radial light intensity from an ideal pour, source quaru^odine lamp of the 
type used projected onto a flat surface normal to the beam tends to follow a pattern 
or distribution known as a Gaussian curve. While not exact, there is a region some 
distance from the centre of the pattern where the light intensity falls off in a roughly 
5 linear manner with the distance from the centre. The superposition of two such light 
patterns can result in one of three distinct combined patterns, depending on the 
separation s between the centres of the patterns: 

' a single peak when s is small 

' two adjacent peaks when s is large 

10 • a combined pattern with a reasonably flat cenfce at an appropriate value of s 

The explanation of the last case involves th> overlap of the roughly linearly 
decreasing intensity region from one light wih the roughly linearly increasing 
region from the second light, A pair* of lamps, suitably positioned, can thereby 
create a region of substantially uniform and constant light intensity, with a roughly 
15 linearly decreasing intensity region around that reasonably uniform and constant 
region. By combining two such pairs of lights ii is possible to create a larger area 
of uniform and constant intensity between the lights. This may be extended with 
additional pairs. 

In the first implementation of Instrument 1 the Colour Region Lights 42 1-426 are 

io arranged in such pairs: lamps 421 & 422, lamps 423 & 424, and lamps 425 & 426, 

Y in order to take advantage of the above theor). However, the beams from the 
■ 

Colour Region Lights 421-426 are inclined at 30 degrees away from the vertical or 
at 30 degrees to the normal to the top surface of Tray 701a. This distorts the 
: circular light pattern into an elliptical light pattern. In addition, the field from a 
quartz iodine lamp of the type used does not creae a perfectly circular field in the 
first place, as the filament which has finite dimensions does not act as a perfect 
point source. 

Adjustment of the Colour Region Lights 42M::6 to achieve a flat field in Colour 
Region 420 requires that the position of each ligitt along the Colour Region Light 
30 support frame 427 and the tilt of each light with respect to the frame be adjusted. 
The adjustment are done on each pair of lights separately, with the light field being 



SQ/ZE'd 8E9-0KI 



0Z9T89E6 Z 13 Q11 SDIhJhraiadlOd 



21 



monitored with the aid of TV colour camera 405 and diagnostic software on Host 
computer 610. It is sufficient for the application to maintain a light field flat to 
within 1% RMS and this is done. This adjustmcit is dene each time the Colour 
Region Lights 421-426 are changed. 
5 In the second impiemention of the Instrument I the adjustment of the Colour Region 
Lights 421 & 423 to produce a reasonably flat light field requires that the position 
of each light along the Colour Region Light suppcrt frarrie 427 and the tilt of each 
light with respect to the frame be adjusted. It is sufficient for the application to 
maintain a light field flat to within 30% of average and this h done. Normalisation 
10 of the image of the object to an effective flat light field is done against the image of 
the reference white field by the software when the image of the object is acquired. 
The adjustment of the light field is done each time either of the Colour Region 
Lights 421 &. 423 are changed. 
Normal Operation 

15 The normal mode of operation of Instrument 1 is for an operator to place a Tray 

701 or a Tray Stack 701b onto Tray Dropper unit 100 and to activate the program 

in Host computer 610. Tray Dropper unit 100 will then drop a single Tray 701 onto 

• Conveyor 300, which will then pass it through TV camera field of view 460, as 
mm 

shown by Tray 701a, where the images of the stap.es are captured for analysis, and 

•Y.io: finally Tray 701a will reach Tray Lifter unit 200 where it will be removed from 
» * • 

Conveyor 300. 

« • 99 

m « » 

Tray Dropper unit 100 places each Tray 701 from Tray Stack 701b onto 
Conveyor 300, one at a time, with a two-phase mechanism, consisting of Tray 
\X; Dropper Rails 10la,b and Tray Dropper Flaps 102c ,b. Normally Tray Stack 701b is 
^25 supported by the top horizontal section of Tray Drcpper Flaps I02a,b. When a Tray 

ft 9 4 

11,/ 701 is to be placed on Conveyor 300 the Tray Dropper Rails 101a,b rise to just 
• • *» 

under Tray Dropper Flaps 102a,b. These then open, allowing Tray Stack 701b to 
■XI* drop a few millimetres onto Tray Dropper Rails 10sa,b. Tray Dropper Flaps 102a,b 
*> then close, such that the top horizontal section is between the bottom tray and the 
30 neXt-to-bottom triy in Tray Stack 701b. The between-tray spacing of about 10 mm 
and the distance Tray Stack 701b drops on each cycle combine to ensure this. Then 
Tray Dropper Rails 10la,b descend to Conveyor 300* placing the bottom Tray 701 
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onto Conveyor belt 305. As Tray Dropper Rails 101a,b descend the rest of Tray 
Stack 701b, which had been supported by the bottom Tray 701, hits the top 
horizontal section of Tray Dropper Flaps 102a,b ind becomes supported by them 
instead. The Tray Stack 701b now has a new bottom tray. 

5 Tray Stack 701b is supported at the back by Dropper Back Wall 108 and lateral 
positioning of Tray Stack 701b in the direction of Conveyor 300 is constrained by 
Dropper Back Wall guides 109 & 110, such that thi position of any Tray 701 when 
thus placed on Conveyor 300 is repeatabie within a few millimetres each time. 
Should Tray Stack 701b be incorrectly assembled or incorrectly placed on the 

10 Tray Dropper Flaps 102a,b p such that the operation of Tray Dropper unit 100 might 
be prone to failure, Tray-Stack-Fault sensor 505a, b will detect an improper stacking 
and provide an error signal to Microcontroller 601. In addition, Tray-under- 
Droppef sensor 503 serves to check that Tray 701 has been successfully placed on 
Conveyor 300. When there are no tnore trays on Trzy Dropper unit 100 (ie Tray 

15 Stack 701b is empty), Tray-on-Stack sensor 501 is no longer activated, and this is 
sensed by Microcontroller 601. 

Motion of Conveyor 300 is handled by Microcontroller 601. Conveyor belt 
motor 304 is started and Tray 701 under Tray Dropper unit 100 is advanced towards 

• ■ mm 

TV camera field of view 460. The mechanism for stopping Conveyor 300 depends 

•••• 

•*^(T; on the situation: 

[ m m * If there is already a Tray 701a in TV camera field of view 460 the motion of 
Conveyor 300 will be controlled by Tray 701;i and a combination of Tray 
: Movement sensor A 509 and Tray Movement sensor C 5 1 1 . 

mm m m 
mm* m 

: " If there is no Tray 701a already in TV camera field of view 460 then Conveyor 
300 will advance the newly dropped Tray 701 until it interrupts the beam of Tray 

• • • 

• • ■ 

Movement sensor A 509. The exact halting position of Conveyor 300 is the instant 
that the beam from Tray Movement sensor A 509 oeases to be interrupted. At this 
".••I" stage Tray 701 becomes effectively Tray 701a. 

mm p 
* » * 

- When Tray 701a leaves TV camera field of view 460 only Tray Movement 
30 sensor C 51 1 will detect the passage of the final Tray Slot 702. 
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When Tray Dropper Rails I01a,b are fully down, as sensed by Tray Dropper 
Rail pneumatic actuator sensors 104a-d, and Tray 701 is on Conveyor 300, Barcode 
Reader unit 640a, b is triggered to do a read from bdicode label 642 on the Tray 
701. This should be successfully performed when Tray 701 has just been deposited 

5 on Conveyor 300 or within the first 10mm of movement. Barcode Reader unit 
640a, b reports this barcode label 642 Co Host computer 610 via Barcode-Host line 
641. A successful reading of barcode label 642 is an essential precursor to Tray 701 
being imaged. If barcode label 642 cannot be read successfully within a short time, 
typically a few seconds, Barcode Reader unit 64()a,b reports this failure to Host 

10 computer 610 which then takes appropriate action, Such action is normally to 
complete the imaging of the previous Tray 701a and then to halt Conveyor 300 and 
alert the operator, who may either remove the unidentified Tray 701 or manually 
enter a barcode number for that tray. 

On entering TV camera field of view 460 a particular staple in a Tray Slot 702 

15 first enters Colour Region 420. Once Conveyor 300 is stationary Host computer 610 
takes RGB images of TV camera field of view 460. The RGB images contain the 
colour image of the particular staple in Colour Region 420: this information is 
extracted from the images and analysed for staple presence, colour information and 

• # 

geometry information. At the same time, another staple may be in Crimp Region 
430 and subject to crimp analysis. Once diis has been done Conveyor 300 then 

• • • 

advances the distance of one Tray Slot 702 plus om Tray inter-slot gap 703, which 
places the particular staple in-between Colour Region 420 and Crimp Region 430. 
RGB images are again taken by Host computer 610 of the whole TV camera field of 

mm » 

view 460, but no information is collected for the particular staple. Other staples in 
25 the RGB images may be subject to colour and crimp arialysis. Once this has been 
done Conveyor 300 advances the Same distance again such that the particular staple 

• * • • 

is in Crimp Region 430. RGB images are again taken by Host computer 610 and the 
crimp information for the particular staple is extracted and analysed. This completes 

» i • 

• »• 

m «. ; the analysis for the particular staple. The analysis of other staples is interleaved with 

• • • 

30 this analysis. 

When the whole Tray 701a has passed through TV caitiera field of view 460 and 
all staples have been imaged and analysed, Tray 70 la proceeds to Tray Lifter unit 
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200. Any foilure during the passage of Tray 70U through TV camera field of view 
460 may invalidate the resuLts for Tray 701a. In this case Conveyor 300 is halted 
and the operator is alerted to remove Tray 701a for a repeat passage. If the 
measurement of the whole Tray 701a is successfil the information concerning the 
staples in Tray 701a is accumulated, possibly averaged or otherwise statistically 
analysed, and the results arc identified by barcodi label 642 and other information 
which may include time, date, instrument number, operator ID, etc. 

On passing under Tray Lifter unit 200 the Tay 701a is eventually physically 
blocked by Lifter Tray barrier 213, which acts at the level of the Tray Slot 702 
rather than the top surface. At the same time the Tray Slot 702 interrupts the Tray- 
at-End sensor 506, which is sensed by Microcontroller 601, Tray Litter Rails 
201a 5 b are raised, lifting Tray 701a past Tray Lifter Pawls 202. After a brief pause, 
typically about one second, Tray Lifter Rails 2Cla,b are dropped back down to 
Conveyor 300. The positions of Tray Lifter Pawls 202 ire such that Tray 70 la is 
caught during descent and rests on them, in a manner similar to that performed by 
Tray Dropper Flaps 102a,b. The trays are all stopped at the same physical location 
by Lifter Tray barrier 213 which ensures that they stack together on Tray Lifter unit 
200 in the same manner as on Tray Dropper unit 100. The function of 
Microcontroller 601 is to relieve Host compute)- 610 of most of the real-time 
operation of Mechanical Tray Handling subsystem 2. Host computer 610 typically 
instructs Microcontroller 601 to "advance to the next slot", and the rest of the 
details of control are performed by Microcontroller 601. Other common commands 
from Host computer 610 to Microcontroller <i01 include "initialise", "clear 
conveyor", "start new tray" and "finish old tray 1 '. "Initialise" ensures that 
Mechanical Tray Handling subsystem 2 is in a safe state before turning the 
compressed air on in Compressed Air Supply 630. "Clear conveyor" advances 
Conveyor 300 and unloads trays at Tray Lifter Unit 200 as long as there is a blocked 
beam signal from any of Tray-under-Dropper sensor 503, Tfay Movement sensor B 
510 dhd Tray-under-Lifter sensor 507, "Start new bay" and "Finish old tray" ensure 
synchronisation between Host computer 610 and Microcontroller 601 for each tray. 
Other diagnostic commands for detailed testing of tie hardware may be included in 
the program for Microcontroller 601. 
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The information recorded by Host computer 610 forms two-dimension (2-D) 
arrays of pixels (picture elements) representing the RGB images, A separate 2-D 
array is recorded for each of the three colour channels Red, Green and Blue (RGB) 
5 generated by the camera. The values of the pixels range from about zero, 
representing darkness, to a full-scale value dependent on the hardware used in the 
particular implementation and representing maximum brightness. The three values 
representing any single pixel in the Colour Region ;ire deferred to as an RGB vector. 
The images are analysed by a computer program in three stages. 
10 1. Analysis of colour for wool and dirt and din disiribution- 

2. Analysis of staple geometry: length, width, tip-s lape etc; 

3. Analysis of staple crimp frequency and crimp definition. 

Tasks 1 & 2 are done with RGB information obtained from Colour Region 420; 
task 3 is done with the information obtained from Crimp Region 430 using one 
15 colour channel only. 

The tray containing the staples goes through the TV camera field of view 460 in 
steps, advancing one tray slot at a time. A full TV image is taken at each step, A 
particular staple first appears in Colour Region 420 where the information for tasks 
1 & 2 is collected from the image. It then is moved to the region between Colour 
.*■?.<): Region 420 and Crimp Region 430. No information about the staple is collected at 
this step. On the next step the particular staple is moved into Crimp Region 430 
where the information for task 3 is collected. 

» ■ » a 

Colours normally associated with raw wool covjr a limited range, and may be 

broken into three categories: dirt (typically indu.try classifications include red, 

••Ss : brown, grey and black), raw wool (industry typicily uses various shades of white 
«> • • • 

and pale yellow), and other (for example identification colours used during lambing, 
colours due to biological damage, grass stains, etc). In general it is not necessary to 
'!"*.: the exact colour of the w ° o1 or an y dirt; it ^ usually sufficient to use a limited 

range- of colour values such are given as examples here. For research use the 
30 average XYZ values of the wool and dirt areas may instead be reported after this 
step has been done. 
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The information obtained from this analysis may be listed for each staple. It may 
also be collected for all staples in one tray and averaged, and listed as average 
information for the tray as identified by the operator or by the barcode libel On the 
tray. 

Image processing techniques are discussed in numerous texts, such as 
"Fundamentals of Digital Image Processing", A K Jain, Prentice Hall, 1989, ISBN 
0-13-336165-9, ( herein referred to as "Jain") and "Digital Picture Processing", 
vols 1 & 2, A Rosenfcld & A C Kak, Academic Press, 1982, ISBN 0-12-597301*2, 
(herein referred to as R&K), the contents of wh;ch are incorporated herein by cross 
reference. Computer code for common algorithms may be obtained from several 
sources including "Numerical Recipes; the Art of Scientific Computing", (Fortran 
version) by W H Press, B P Flannery, S A Teukdlsky and W T Vetterling, 
Cambridge UP, 1992, ISBN 0-52-133330-7 (heiein referred to as NR) the contents 
of which is incorporated herein by cross reference 

The colour analysis for wool staples (step 1) proceeds according to flow diagram 
1200 in Figure 5. The individual steps conducted during the colour analysis by Host 
computer 610 are outlined below: 

In step 1201 the number of pixels above a particular intensity level within the 
region of interest are counted: if the number exceeds a threshold there is a staple 
present. The particular intensity level is a parameter dependent on the particular 
implementation and is chosen to distinguish betueen the staple region in the image 
and the tray background (which is not staple) in the image. 

a. The region of interest is typically the area within the Tray Slot 702 in Colour 
Region 420, but may be altered according to the t/pe of staple being examined. 

b. The threshold number used to indicate that a staple is present may depend on the 
typical type and size of wool being examined. 

In step 1202 the region of interest is subjected to a thresholding operation (see 
section 7.2 in Jain or section 10.1.2 in A&K) in which all pixels with values less 
than a particular level are set to a zero value in order to distinguish in subsequent 
operations between pixels considered to be repiesenting a staple and pixels not 
representing a staple. The threshold used will depend on the hardware in use, which 
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typically may have scale ranges of 0-63 (6 bits), 0-255 (8 bits), 0-1024 (10 bits). 
This operation will leave a large contiguous area of non-zero pixels representing a 
staple, but may also leave other small areas of non-zero pixels representing 
irrelevant objects such as dust particles. The removal of the small areas may be 
s done by one of the following methods: 

a. erosion and dilation (see section 9.9 of Jain) ovur the region of interest, or 

b. labelling all contiguous non-zero regions within the area of interest (see section 
9.13 of Jain) and then converting the pixels all but the largest labelled region to 
zero. 

10 The remaining non-zero region of pixels is termed the thresholded object. 

In step 1203 the RGB vector for each pixel in the thresholded object is multiplied 
by a 4x3 conversion matrix to generate the Cl)i (Commission Internationale de 
l'Eclairage) XYZ vector for that pixel (see section 3.8 of Jain). X, Y and Z values 
range roughly from 0 to about 100 for the normal range of colours. The XYZ space 
15 is used as it is an international standard and is icnown to be obtainable from the 
RGB space with a linear transform (sec p67 in Jain). The elements of the 4x3 
conversion matrix are typically derived by linear regression for each system by a 
calibration process based on the Qse of coloured objects of known XYZ values. 
The reduction of the XYZ colour space to a small number of typical industry 
*20 classifications or colour values may be done by one of the following processes; 
others may be used to ontain equivalent information; 

» 4 

a. Maximum Likelihood Estimation (see section 8.15 of Jain and section 14.6 of 
NR) 

• • • » 

b. Principle Component Analysis (see section 7.6 of Jain). 

In step 1204 such a reduction is applied to each pixel in the thresholded object. 
In step 1205 a count of the pixels in the thresholded object with each colour 
value is made. For those colours corresponding to dirt which may be found in wool, 
: the colour with the highest numeric representation is Selected as most probable and 
pixels with the other dirt colours are altered to show the selected or most probable 
30 dirt colour. This dirt colour according to typical industry classifications and/or the 
average XYZ values for the dirt area are reported. 
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In step 1206 those pixels with colours corresp onding to raw wool are similarly 
all given the most likely raw wool colour, as in step 1203. This wool colour 
according to typical industry classifications and/or the average XYZ values for the 
dirt area are reported. 

In step 1207 the location of the transition from dirt region to raw wool region 
along the length of the staple, termed "dust penetration", is determined by: 

a. condensing the 2D array of pixels to two ID vectors alohg the length of the 
staple, with one ID element representing the count of dirt pixels and the second ID 
vector representing the count of raw wool pixels, sach in the corresponding coluftin 
in the 2D array, 

b. locating the 50% transition point between dirt and raw wool pixel counts from 
the two vectors. 

If the tip region of the staple contains a significint quantity of clean wool pixels, 
the location bf the transition from clean wool to dirt is located in a similar manner 
and this is recorded as a H \vash<lown ,, distance. 

Other statistical properties of the colour image may be obtained from the above 
parameters, including 

a. Percentage dirt region (proportion of dirt area to total staple area) 

b. Percentage wash-down region (proportion of wa:ih-down area to total staple area) 
In task 2 the geometry analysis is done according to flow diagram 1300 in Figure 

6 In step 1301 the borders enclosing the threstolded object are found by the 
following steps; 

a. generating a ID staple width vector with eiemer ts corresponding to the Count of 
non-zero pixels in the corresponding columns in the object image 

b. generating a ID staple length vector with elements corresponding to the count of 
non-zero pixels in the corresponding rows 

c. scanning the elements in each ID vector in two directions, from the first towards 
the last one and from the last towards the first one, and locating the elements where 
the number of non-zero pixels first exceeds a threshold appropriate to the system d. 
for the staple length vector the position of the left :jid right transitions are referred 
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to as the left and right borders: for the staple width vector the position of the upper 
and lower transitions arc referred to as the top ard bottom borders. 

In step 1302 the distance between the upper und lower borders is calculated and 
is termed the width of the object; the distance bitween the left and right borders is 
5 calculated and is termed the length of the object. The length and width of the object 
may be expressed in pixels counts or may be converted to millimetres according to 
the pixel space to image space conversion factor. This conversion factor may be 
derived simply by analysis of an object of known size. In step 1303 the staple width 
vector is analysed at the tip end of the staple for the slope of the transition from the 
io end of the staple to the main body of the staple. The distance between the 25% 
width and 75% width is termed the tip shape parameter. This is converted to a tip 
grade with a final scale of A-E by reference to a calibration scale derived from a 
number of experienced wool industry operators. 

In task 3 the crimp analysis is according to f ow diagram 1400 in Figure 7, In 
15 step 1410 the presence of an object of staple size in the image is checked. This may 
done by using the Staple-present information from the colour analysis step 1202 if 
this was done first, or it may be done again in a similar manner. 
. ^ In step 1402 a thresholded version of the imag; is created. This may be done by 
;,. using the information from step 1202, or if there is a possibility that the staple may 
have moved within the slot since that information was calculated then the same 
procedure as in step 1202 may be repeated. The threshold used may or may not be 
the same as for step 1202, depending on the relaiive light intensities on the colour 
and crimp regions. 

: ': In step 1403 the crimp frequency for the staple is computed, this is done using a 
25 Fourier Transform. The transform may be done using any of several known 
methods (see Chapter 2 in Jain and Chapter 12 in NR). The transform is performed 
on each row in the thresholded staple region of the image, and the spectra for all 
lines are summed to produce an average spectrum for the whole thresholded region. 
.: The analysis is performed for the frequency range of interest, which for raw wool 
30 staples is typically 1 .0 crimp per centimetre to 12 crimps per centimetre. 
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In step 1404 the generated spectrum is simplified and scanned for peaks and the 
frequency of the highest 'amplitude peak, normally above a selected threshold 
frequency, is designated the crimp frequency. This is reported in crimps per 
centimetre to fit in with current wool trade practice. 
5 In step 1405 the shape of the crimp frequency peak is analysed for a number of 
parameters which may be indicative of the crimp definition (where "crimp 
definition" is a term known in the wool trade). The parameters may include 

a, crimp peak height 

b. crimp peak width at half-height, as measured in crimps per millimetre 
10 c. the ratio of the crimp frequency to b., also known in the field of electronics 

engineering as the Q of the peak 

d. any other combinations of the above 

Crimp definition may be reported on a disci-ete step scale siich as A-E or on a 
numeric scale: the former avoids problems with the different ranges for the possible 
15 definitions listed above. Conversion of the numeric value to a step scale value is 
done by reference to a calibration scale derived lrom a number of experienced wool 
industry operators. 

Typical Uxe 

m 

]«m s The normal mode of operation of the Instrument 1 is for an operator to place a 
,;\j20 tray or a stack of trays onto Tray Dropper unit .00 and to activate the program in 

Host computer 610. Tray Dropper unit 100 will then drop trays one at a time onto 
^ ^ Conveyor 300; this will pass the trays through TV camera field of view 460 where 
'.*:./ *e RGB images are captured for analysis, and finally the trays will reach Tray 

Lifter unit 200 where they will be removed from Conveyor 300. 
•.".■*3S When a tray is lowered onto Conveyor 300 Bircode Reader unit 640a,b, which 

has two heads, attempts to read barcode label 642 from one end of the tray or the 
. .. other. Assuming this is successful, the information passed from Barcode Reader unit 

640a,b to Host computer 610 consists of a barcode head identifier (1 for the head 

closest to TV camera field of view 460 or 2 for the head further away) and the ' 
30 barcode label 642 itself. The information about which barcode head furnished 
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barcode label 642 is used to predict the orientation of the staples in the tray: this 
information simplifies the image analysis process. 

The tray enters TV camera field of view 460 and the necessary images arc 
captured by Host computer 610, analysed and summarised as the tray leaves TV 
camera field of view 460 for Tray Lifter unit 200. The collection of information 
about the staples in the tray is then stored in a data file, from where it may be 
printed or transmitted to another computer for further processing. The data collected 
for a typical tray may appear thus: 

Table 1 
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Stupfe 


Width 


Tip 


Crimp 


Crimp 
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Wool 


Wool 


Diri 


Dirt 


Dirt 


Dirt 


No 
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Mean 


14 
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44 


45 


45 


13 
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14 
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• The following comments should be noted for the above results: 

• Not all staples have a dirt region (eg staple no. 6) or allow separation of the dirt 
and wool areas (eg staple no. 5) 

• Staple no. 6 might be a second cut, for oample, and coo short for valid 



5 measurement 

•XYZ values have been reported rather than industry colours in this case 

• Clean wool is not a bright white with XYZ values near 100; the values shown are 
typical of many wool types 

These results shown in Table 1 are broadly consistent with the results obtained by 
10 two experienced human assessors, subject to the following notes: 

■ Human ability to assess staple width is poor in comparison with objective 
measurement systems such as Instrument 1: an error range of 3 mm would be 
typical. In addition, different operators will typicilly have different definitions of 
the end of a staple unless continuous retraining and normalisation is conducted. 

• ■ • ■ 

# !?. 5 „ >Tip grade is assessed b y different people in different ways, and is therefore a poor 
t .. ; - : subjective metric. The algorithms used classify the tip into one of five categories as 

\\i defined by mathematical criteria: for the purpose of staple assessment this is 
»« 

: • : considered enough. 

. „ - Crimp frequency is quoted in Table 1 to 1 crimp/cm, but is easily measured to 0.1 
#•» » 

/•je. crimp/cm for values below 10 crimp/cm. Human assessment can easily be in error 
by 10-20%. 

■ it* 

• • » 

'.I..' ' Crim P definition is assessed by different people in different ways, and is therefore 
a poor subjective metric. Resolution to better than three grades would not be 
','.*.' COmmon - The algorithms used are generally accurate to 1%. 

9 9 m 

'.25! ■ Wool colour and dirt colour are rarely measured by humans; rather a classification 
into red, brown, grey etc categories is done. Considerable variation exists between 
humans at the borderlines between colours. Of greater significance is the generally 
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accepted limit to colour measurement of 2 units in X, Y and Z. The measurements 
shown in Tabic 1 are typically repeatable to 1 unit, although natural variation across 
a staple may be up to 10 units. 

* The assessment of dirt area by humans wou,d rarely resdive more than 10 
percentage levels (deciles). The assessment by the algorithms may be affected by the 
selection of the threshold levels in the algorithms but is reproducible to 1 % for a 
given threshold. 

Throughout the specification the term "comprising" is to be taken as meaning 
any one of "including", consisting essentially oP or "consisting of". The term 
comprise(s) is to be taken as meaning any one of of u include(s)", consists 
essentially of" or "consists of". 
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The claims defining the Invention are as follows 4 ; 

1 . A method for determining at least two different visual properties of an object, 
comprising: 

(I) determining a first parameter of ths object by: 

6 (a) locating the object in a first parameter measurement interaction volume; 

(b) illuminating the object in the first parameter measurement interaction volume 
with a light field selected from the group consisting of a substantially uniform 
measurement light field and an effectively uniform measurement light field to produce non 
surface relief measurement outgoing light containing visual information related to non 

10 surface relief features of the object; 

(c) detecting the non surface relief measurement outgoing light and generating 
signals therefrom whereby the signals arc a function of the first parameter; and 

(d) determining the first parameter from the signals; 

(II) determining a second parameter of die object by: 

i b (a 1 ) locating The object in a second parameter measurement interaction volume ; 

(h*) Illuminating the object in the second parameter measurement interaction 
volume with a directional measurement light field so as to produce surface relief 
measurement outgoing light containing visual information related to surface relief features 
of the object; 

20 ^ (c') detecting the surface relief measurement outgoing light and generating signals 
therefrom whereby the signals are a function of the second parameter; and 

(d') determiiiing the second parameter fi om the signals; 
wherein at least one of steps (b) and (b J ) comprises illuminating said object at a location 
selected from the group consisting of; on a reflating surface, on a gloss black surface, on 

za a substantially non-reflecting surface, on a fL'tt black matt surface, against a reflecting 
background, against a substantially non-refltcting background, against a gloss black 
background, and a against a flat black matt bad ground. 

2. The method of claim 1 wherein the substantially uniform measurement light 
field is also a substantially constant measurement light field. 

3, The method of claim 2 wherein tho substantially constant measurement light 
field is a flat light field. 

4> The method of claim 1 wherein the ise of an effectively uniform measurement 
light field comprises illuminating the object with a non flat light field and normalising the 
image of the object against an image of a substantially uniform flat white or substantially 
uniform flat near white object as detected by detecting the outgoing light (by detector) in 
the same light field. 

5. The method of any one of claims i to 4 wherein step (b) comprises 
illuminating said object in a location selected from the group consisting of: on a non- 
reflecting surface, on a substantially non-reflecting surface, on a flat black matt surface, 
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against a non-reflecting background, against a substantially non-reflecting background, 
and against a flat black matt background. 

6. The method of any one of claims 1 to 5 wherein step <b') comprises 
illuminating said object in a location selected from the group consisting of: on a reflecting 

e surface, on a gloss black surface, on a substantially non-reflecting surface, on a flat black 
matt surface, against a reflecting background, against a substantially non-reflecting 
background, against a gloss black background, and against a flat black matt background. 

7. The method of any one of claims 1 to 5 wherein the object comprises one or 
more fibrous objects selected from the group consisting of a clump of fibres, a staple of 

io fibres, raw wool staples, wool staples, synthetic fibres, natural fibres, dyed fibres, a 
fibrous strand, a filament, a yarn, a clump of filaments, a clump of yarns, a clump' of 
fibrous strands, a staple of filaments, a staple of yarns, a staple of fibrous strands, cotton 
staples, raw cotton staples, goat hair staples, aad raw goat hair staples. 

8. The method of any one of claims 1 to 5 wherein the first parameter is selected 
is from the group consisting of colour, colour d>stribution, shape, diameter, area, chemical 

composition, number of parts, width, length, absorptivity, reflectivity, dielectric constant, 
fluorescence, position, orientation, and density. 

9. The method of any one of claims 1 to 5 wherein the second parameter is 
selected from surface relief features selected fnm the group consisting of shadowing, self 

20 shadowing, surface texture, surface periodicity surface regularity, other surface detail, 
surface wavincss, surface crimp, surface roughiess and surface profile, 

10. A method for deterrnining at least two different visual properties of an object, 
comprising: 

(J) determining a first parameter of the object by: 
25 (a) locating the object in a first parameter measurement interaction volume 

(b) illuminating the object in the first t arametex measurement interaction volume 
widi an effectively uniform measurement light field comprising a non flat light field to 
produce a non surface relief measurement outgoing light containing visual information 
related to non surface relief features of the object; 

so (b)(i) normalising Lhe image of the object ugainst an image of a substantially uniform 
flai white or substantially uniform flat near whit; object; 

(c) detecting the non surface relief measurement outgoiog light in the same light 
field and generating signals therefrom whereby the signals are a function of the first 
parameter; and 

36 (d) determining the first parameter from the signals; 
(I) determining a second parameter of the object by: 

(a") locating the object in a second parameter measurement interaction volume; 
(b') illuminating the object in the seomd parameter measurement interaction 
volume with a directional measurement light field so as to produce surface relief 
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measurement outgoing light containing visual information related to suf face relief features 
of the object; 

(c 1 ) detecting the surface relief measuiement outgoing light and generating signals 
therefrom whereby the signals are a function of the second parameter; and 
5 (d') determining the secohd parameter from the signals. 

11. An appararus for determining at least wo different visual properties of an 
object, comprising: 

(I) means for determining a first parameter of the object comprising: 

(a) means for locating the object in a first parameter measurement interaction 
io volume; 

(b) means for illuminating the objxt in the first parameter measurement 
interaction volume with a light field selected from the group consisting of a substantially 
uniform measurement light field and an effectively uniform measurement light field to 
produce non surface relief measurement outgoing light containing visual information 

i (5 related to non surface relief features of the object; 

(c) a detector for detecting the non surface relief measurement outgoing light and 
generating signals therefrom whereby the signals are a function of the first parameter, the 
detector being operatively associated with the means for illuminating of (b); and 

(d) means for determining the fust piramcter from the signals, the means for 
20 determining being operatively associated with the detector of (c); 

(II) means for determining a second parameter of the object comprising: 
(a') means for locating the object in a second parameter measurement interaction 
volume; 

(b') means for illuminating the object In the second parameter measurement 
2b interaction volume with a directional measurement light field so as to produce surface 
relief measurement outgoing light containing visual information related to surface relief 
features of the object; 

(c') a detector for detecting the surface relief measurement outgoing light and 
generating signals therefrom whereby the signals are a function of the second parameter, 
30 die detector being operatively associated with the means for illuminating of (b*); and 

(d 1 ) means for determining the second parameter from the signals, the means for 
determining being operatively associated with die detector of (O; 
wherein at least one of said measurement interaction volumes of (b) and (b') there is a 
surface or background proximate a location whsre side object is illuminated or means for 
35 locating a surface or background proximate a location where said object is illuminated, 
said surface or background being selected from the group consisting of; a reflecting 
surface, a gloss black surface, a substantially non-reflectiiig surface, a flat black matt 
surface, a reflecting background, a substantial!) non-reflecting background, a gloss black 
background, and a flat black matt background wherein when said object is illuminated at 
$aid location said object is at a location selected from the group consisting of: on a 
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reflecting surface, on a gloss black surface, 0)i a substantially non-reflecting surface, on a 
flat back mate surface, against a reflecting background, against a substantially non- 
reflecting background, against a gloss black background, and against a flat black matt 
background. 

b 12. The apparatus of claim 11 wherein the means for illuminating the object in the 
first parameter measurement interaction compi ises means fof illuminating the object in the 
first parameter measurement interaction volume with a substantially constant light field. 

13. The apparatus of claim 11 wherein the means for illuminating the object in the 
first parameter measurement interaction comprises means for illuminating the object in the 

io first parameter measurement interaction volume with a substantially constant and flat light 
field. 

14. The apparatus of claim 11 wherein the use of an effectively uniform 
measurement light field comprises illuminating the object with a non flat light field and 
normalising the image of the object against an image of a substantially uniform flat white 

is or substantially uniform near white object as detected by detecting the outgoing light (by 
the detector) in the same light field. 

15. The apparatus of claim 11 further including meaJus to separate the first 
parameter measurement interaction volume from the second parameter measurement 
interaction volume. 

20 16, The apparatus of claim 11 wherein the detector for delecting the non surface 
relief measurement outgoing light and the detector for detecting the surface relief 
measurement outgoing light is a single detector which is an image detector. 

17. The apparatus of claim 16 whereii the image detector is selected from the 
group consisting of video camera, line scan camera and a flying spot scanner. 
2B 18. The apparatus of claim 11 further comprising: 

(dd) means for determining statistical information in respect of a measurement of the 
first and/or second parameter for an object, operatively associated with the means for 
determining the first and/or second parameters. 

19. The apparatus of claim 18 further comprising: 

so (ddd) means for determining statistical information in respect of a plurality of 
measurements of (dd) for a plurality of objects, operatively associated with the means for 
determining of (dd). 

20. The apparatus of claim 11 further comprising at least one of the following 
means selected from the group consisting of: 

35 (i) means for determining the first parimetcr of the object from measurement 
parameter determined from the signals which are a function of the first parameter, 
operatively associated with the detector(s) of (c), 

(ii) means for storing the measurement parameter determined from the signals which 
are a function of the first parameter, operatively associated with the detector (s) of (c), 
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(iii) means for storing the first paramet'^ of the object operatively associated with 
the means for determining the first parameter; 

(iv) means for retrieving the measurement parameter of the object operatively 
associated vvith means for storing the measurement parameter determined from the signals 

5 which arc a function of the first parameter; and 

(v) means for retrieving the first parameter of the object operatively associated with 
the means for storing the first parameter. 

21. A method for determining at least iwo different visual properties of an object, 
substantially as herein described with reference to the Figures. 
to 22. An apparatus for determining at Jeast two different visual properties of an 
object, substantially as herein described with reference to the Figures. 

DATED 30 June 1999 
Commonwealth Scientific and Industrial Research Organisation 
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Systems and Methods for featuring at Least Two 
Visual Properties of an Object 

ABSTRACT 

A method and apparatus for determining at least two different visual properties of 
an object are disclosed. The method comprises (I) determining a first parameter of 
the object by: (a) locating the object in a first parameter measurement interaction 
5 volume; (b) illuminating the object in the first parameter measurement interaction 
volume with a light field selected from the group consisting of a substantially 
uniform measurement light field and an effectively uniform measurement light field 
to produce non surface relief measurement outgoing light containing visual 
information related to non surface relief feature; of the object; (c) detecting the non 
10 surface relief measurement outgoing light and generating signals therefrom whereby 
the signals are a function of the first parameter; and (d) determining the first 
parameter from the signals; (II) determining a second parameter of the object by: 
(a') locating the object in a second parameter measurement interaction volume; (b*) 
• t illuminating the object in the second parameter measurement interaction volume 
( J15 with a directional measurement light field so as to produce surface relief 
measurement outgoing light containing visual in formation related to surface relief 
features of the object; (c') detecting the surface relief measurement outgoing light 
and generating signals therefrom whereby the signals are a function of the second 

« 

parameter; and (d*) determining the second parameter from the signals. 



.'20 

• ••• 

• • 

• t«« 



• »# 
• • • 
• 



[ 

6£/I£"d 8£9'0SJ 0<i0T89£6 2 13 dll SDINHD3iab"IOd 0002 "abW ' 




0^0T39£6 2 13 Ql~! SDIWHD31dbn0d 



£S:8 0002*abW'ES 



2/8 





I 



J 



0Z0T3966 2 13 dll SDIWHD3iatn0d ££:B 0002*ybWE2 



4/8 



I « • 
« • « 



m 9 * 



■ • « 
ft • • 




<7> 



fT CO f—- 
^ ^ ^ 



8E9 Tiw 



0^0T89E6 2 13 Oil SDIM^ 1 ^n^L 



6/8 



120 1 



Check staple present in 
image 



120: 



Threshold ixnajjc arid 
remove small objects 



1200 



1203- 



Convert image fr>m RGB 
c y space to XYZ space 



120 



Convert pixel XY Z values 
to colour vaJaes 



»« *• 



1205- 



120 



120' 



Determine lilely 
dirt colour 



Determine likely 
*ool colour 



Determine dirt 
position 



Figure 5 



0«i0T89£6 2 T9 ail SDINHD3iatTI0d 



t7S:8 0002 ' ay W 



7/8 



» • 



130: 



1303- 



Find left and right, top 
and bottom borders 



Calculato Icrigth, w;dth and 
are! of object 



Calculate tip shape parameter 
from width vector 



1300 



Figure 6 



6S/8S'd 8£9'0W 



0^0I89£6 2 T3 Q11 SDINhOBldtnOd 



*S:8 0002 'dbW £2 



8/8 



Check staple present in 

Imago ^- 



140J- 



2. 



Threshold imige 



I 



Do Foiirier Transform 
on thresholded staple 



Analyse spectrum for 
crimp peak 



Analyse crimp peak for 
crimp definition 



1400 



Figure 7 



SS/6£'d BSS'OU 



0Z0I89E6 2 13 dll SDINhOBiatHOd 



t?S:8 0002'ybW'E2 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 
QsBLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: " 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



